The challenge of negotiation in the game of Diplomacy

The game of Diplomacy has been used as a test case for complex automated negotiations for a long time, but to date very few successful negotiation algorithms have been implemented for this game. We have therefore decided to include a Diplomacy tournament within the annual Automated Negotiating Agents Competition (ANAC). In this paper we present the setup and the results of the ANAC 2017 Diplomacy Competition and the ANAC 2018 Diplomacy Challenge. We observe that none of the negotiation algorithms submitted to these two editions have been able to significantly improve the performance over a non-negotiating baseline agent. We analyze these algorithms and discuss why it is so hard to write successful negotiation algorithms for Diplomacy. Finally, we provide experimental evidence that, despite these results, coalition formation and coordination do form essential elements of the game

The effect of ICU-tailored drug-drug interaction alerts on medication prescribing and monitoring: Protocol for a cluster randomized stepped-wedge trial

Background: Drug-drug interactions (DDIs) can cause patient harm. Between 46 and 90% of patients admitted to the Intensive Care Unit (ICU) are exposed to potential DDIs (pDDIs). This rate is twice as high as patients on general wards. Clinical decision support systems (CDSSs) have shown their potential to prevent pDDIs. However, the literature shows that there is considerable room for improvement of CDSSs, in particular by increasing the clinical relevance of the pDDI alerts they generate and thereby reducing alert fatigue. However, consensus on which pDDIs are clinically relevant in the ICU setting is lacking. The primary aim of this study is to evaluate the effect of alerts based on only clinically relevant interactions for the ICU setting on the prevention of pDDIs among Dutch ICUs. Methods: To define the clinically relevant pDDIs, we will follow a rigorous two-step Delphi procedure in which a national expert panel will assess which pDDIs are perceived clinically relevant for the Dutch ICU setting. The intervention is the CDSS that generates alerts based on the clinically relevant pDDIs. The intervention will be evaluated in a stepped-wedge trial. A total of 12 Dutch adult ICUs using the same patient data management system, in which the CDSS will operate, were invited to participate in the trial. Of the 12 ICUs, 9 agreed to participate and will be enrolled in the trial. Our primary outcome measure is the incidence of clinically relevant pDDIs per 1000 medication administrations. Discussion: This study will identify pDDIs relevant for the ICU setting. It will also enhance our understanding of the effectiveness of alerts confined to clinically relevant pDDIs. Both of these contributions can facilitate the successful implementation of CDSSs in the ICU and in other domains as well. Trial registration: Nederlands Trial register Identifier: NL6762. Registered November 26, 2018

Challenges and Main Results of the Automated Negotiating Agents Competition (ANAC) 2019

The Automated Negotiating Agents Competition (ANAC) is a yearly-organized international contest in which participants from all over the world develop intelligent negotiating agents for a variety of negotiation problems. To facilitate the research on agent-based negotiation, the organizers introduce new research challenges every year. ANAC 2019 posed five negotiation challenges: automated negotiation with partial preferences, repeated human-agent negotiation, negotiation in supply-chain management, negotiating in the strategic game of Diplomacy, and in the Werewolf game. This paper introduces the challenges and discusses the main findings and lessons learnt per league

Clinically relevant potential drug-drug interactions in intensive care patients:A large retrospective observational multicenter study

Purpose: Potential drug-drug interactions (pDDIs) may harm patients admitted to the Intensive Care Unit (ICU). Due to the patient's critical condition and continuous monitoring on the ICU, not all pDDIs are clinically relevant. Clinical decision support systems (CDSSs) warning for irrelevant pDDIs could result in alert fatigue and overlooking important signals. Therefore, our aim was to describe the frequency of clinically relevant pDDIs (crpDDIs) to enable tailoring of CDSSs to the ICU setting. Materials & methods: In this multicenter retrospective observational study, we used medication administration data to identify pDDIs in ICU admissions from 13 ICUs. Clinical relevance was based on a Delphi study in which intensivists and hospital pharmacists assessed the clinical relevance of pDDIs for the ICU setting. Results: The mean number of pDDIs per 1000 medication administrations was 70.1, dropping to 31.0 when considering only crpDDIs. Of 103,871 ICU patients, 38% was exposed to a crpDDI. The most frequently occurring crpDDIs involve QT-prolonging agents, digoxin, or NSAIDs. Conclusions: Considering clinical relevance of pDDIs in the ICU setting is important, as only half of the detected pDDIs were crpDDIs. Therefore, tailoring CDSSs to the ICU may reduce alert fatigue and improve medication safety in ICU patients

Clinically relevant potential drug-drug interactions in intensive care patients: A large retrospective observational multicenter study

Purpose: Potential drug-drug interactions (pDDIs) may harm patients admitted to the Intensive Care Unit (ICU). Due to the patient's critical condition and continuous monitoring on the ICU, not all pDDIs are clinically relevant. Clinical decision support systems (CDSSs) warning for irrelevant pDDIs could result in alert fatigue and overlooking important signals. Therefore, our aim was to describe the frequency of clinically relevant pDDIs (crpDDIs) to enable tailoring of CDSSs to the ICU setting. Materials & methods: In this multicenter retrospective observational study, we used medication administration data to identify pDDIs in ICU admissions from 13 ICUs. Clinical relevance was based on a Delphi study in which intensivists and hospital pharmacists assessed the clinical relevance of pDDIs for the ICU setting. Results: The mean number of pDDIs per 1000 medication administrations was 70.1, dropping to 31.0 when considering only crpDDIs. Of 103,871 ICU patients, 38% was exposed to a crpDDI. The most frequently occurring crpDDIs involve QT-prolonging agents, digoxin, or NSAIDs. Conclusions: Considering clinical relevance of pDDIs in the ICU setting is important, as only half of the detected pDDIs were crpDDIs. Therefore, tailoring CDSSs to the ICU may reduce alert fatigue and improve medication safety in ICU patients

The EBM-DPSER conceptual model: integrating ecosystem services into the DPSIR framework

There is a pressing need to integrate biophysical and human dimensions science to better inform holistic ecosystem management supporting the transition from single species or single-sector management to multi-sector ecosystem-based management. Ecosystem-based management should focus upon ecosystem services, since they reflect societal goals, values, desires, and benefits. The inclusion of ecosystem services into holistic management strategies improves management by better capturing the diversity of positive and negative human-natural interactions and making explicit the benefits to society. To facilitate this inclusion, we propose a conceptual model that merges the broadly applied Driver, Pressure, State, Impact, and Response (DPSIR) conceptual model with ecosystem services yielding a Driver, Pressure, State, Ecosystem service, and Response (EBM-DPSER) conceptual model. The impact module in traditional DPSIR models focuses attention upon negative anthropomorphic impacts on the ecosystem; by replacing impacts with ecosystem services the EBM-DPSER model incorporates not only negative, but also positive changes in the ecosystem. Responses occur as a result of changes in ecosystem services and include inter alia management actions directed at proactively altering human population or individual behavior and infrastructure to meet societal goals. The EBM-DPSER conceptual model was applied to the Florida Keys and Dry Tortugas marine ecosystem as a case study to illustrate how it can inform management decisions. This case study captures our system-level understanding and results in a more holistic representation of ecosystem and human society interactions, thus improving our ability to identify trade-offs. The EBM-DPSER model should be a useful operational tool for implementing EBM, in that it fully integrates our knowledge of all ecosystem components while focusing management attention upon those aspects of the ecosystem most important to human society and does so within a framework already familiar to resource managers

GDL as a unifying domain description language for declarative automated negotiation

Recently, it has been proposed that Game Description Language (GDL) could be used to define negotiation domains. This would open up an entirely new, declarative, approach to Automated Negotiations in which a single algorithm could negotiate over any domain, as long as that domain is expressible in GDL. However, until now, the feasibility of this approach has only been demonstrated on a few toy-world problems. Therefore, in this paper we show that GDL is a truly unifying language that can also be used to define more general and more complex negotiation domains. We demonstrate this by showing that some of the most commonly used test-beds in the Automated Negotiations literature, namely Genius and Colored Trails, can be described in GDL. More specifically, we formally prove that the set of possible agreements of any negotiation domain from Genius (either linear or non-linear) can be modeled as a set of strategies over a deterministic extensive-form game. Furthermore, we show that this game can be effectively described in GDL and we show experimentally that, given only this GDL description, we can explore the agreement space efficiently using entirely generic domain-independent algorithms. In addition, we show that the same holds for negotiation domains in the Colored Trails framework. This means that one could indeed implement a single negotiating agent that is capable of negotiating over a broad class of negotiation domains, including Genius and Colored Trails

Search algorithms for automated negotiation in large domains

This work presents several new and efficient algorithms that can be used by negotiating agents to explore very large outcome spaces. The proposed algorithms can search for bids close to a utility target or above a utility threshold, and for win-win outcomes. While doing so, these algorithms strike a careful balance between being rapid, accurate, diverse, and scalable, allowing agents to explore spaces with as many as 10 250 possible outcomes on very run-of-the-mill hardware. We show that our methods can be used to respond to the most common search queries employed by 87 % of all agents from the Automated Negotiating Agents Competition between 2010 and 2021. Furthermore, we integrate our techniques into negotiation platform GeniusWeb in order to enable existing state-of-the-art agents (and future agents) to handle very large outcome spaces

GITR engagement in combination with CTLA-4 blockade completely abrogates immunosuppression mediated by human liver tumor-derived regulatory T cells ex vivo

In liver cancer tumor-infiltrating regulatory T cells (Ti-Treg) are potent suppressors of tumor-specific T-cell responses and express high levels of the Treg-associated molecules cytotoxic T lymphocyte-associated antigen 4 (CTLA-4) and glucocorticoid-induced tumor necrosis factor receptor (GITR). In this study, we have evaluated the capacity of GITR-ligation, CTLA-4-blockade and a combination of both treatments to alleviate immunosuppression mediated by Ti-Treg. Using ex vivo isolated cells from individuals with hepatocellular carcinoma (HCC) or liver metastases from colorectal cancer (LM-CRC) we show that treatment with a soluble form of the natural ligand of GITR (GITRL), or with blocking antibodies to CTLA-4, reduces the suppression mediated by human liver tumor-infiltrating CD4(+)Foxp3+ Treg, thereby restoring proliferation and cytokine production by effector T cells. Importantly, combined treatment with low doses of both molecules exhibited stronger recovery of T cell function compared with either treatment alone. Our data suggest that in patients with primary and secondary liver cancer both GITR-ligation and anti-CTLA-4 mAb can improve the antitumor immunity by abrogating Ti-Treg mediated suppression

Emergency Department to ICU Time Is Associated With Hospital Mortality : A Registry Analysis of 14,788 Patients From Six University Hospitals in the Netherlands

OBJECTIVES: Prolonged emergency department to ICU waiting time may delay intensive care treatment, which could negatively affect patient outcomes. The aim of this study was to investigate whether emergency department to ICU time is associated with hospital mortality. DESIGN, SETTING, AND PATIENTS: We conducted a retrospective observational cohort study using data from the Dutch quality registry National Intensive Care Evaluation. Adult patients admitted to the ICU directly from the emergency department in six university hospitals, between 2009 and 2016, were included. Using a logistic regression model, we investigated the crude and adjusted (for disease severity; Acute Physiology and Chronic Health Evaluation IV probability) odds ratios of emergency department to ICU time on mortality. In addition, we assessed whether the Acute Physiology and Chronic Health Evaluation IV probability modified the effect of emergency department to ICU time on mortality. Secondary outcomes were ICU, 30-day, and 90-day mortality. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: A total of 14,788 patients were included. The median emergency department to ICU time was 2.0 hours (interquartile range, 1.3-3.3 hr). Emergency department to ICU time was correlated to adjusted hospital mortality (p 3.7 hr), both compared with the reference category ( 2.4 hr) is associated with increased hospital mortality after ICU admission, mainly driven by patients who had a higher Acute Physiology and Chronic Health Evaluation IV probability. We hereby provide evidence that rapid admission of the most critically ill patients to the ICU might reduce hospital mortality